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Abstract 

We study a quantity that we call coordination complexity. In a distributed optimization problem, 
the information defining a problem instance is distributed among n parties, who need to each choose 
an action, which jointly will form a solution to the optimization problem. The coordination complexity 
represents the minimal amount of information that a centralized coordinator, who has full knowledge of 
the problem instance, needs to broadcast in order to coordinate the n parties to play a nearly optimal 
solution. 

We show that upper bounds on the coordination complexity of a problem imply the existence of good 
jointly differentially private algorithms for solving that problem, which in turn are known to upper bound 
the price of anarchy in certain games with dynamically changing populations. 

We show several results. We fully characterize the coordination complexity for the problem of com¬ 
puting a many-to-one matching in a bipartite graph by giving almost matching lower and upper bounds. 
Our upper bound in fact extends much more generally, to the problem of solving a linearly separable con¬ 
vex program. We also give a different upper bound technique, which we use to bound the coordination 
complexity of coordinating a Nash equilibrium in a routing game, and of computing a stable matching. 
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1 Introduction 


In this paper, we study a quantity which we call coordination complexity. This quantity measures the amount 
of information that a centralized coordinator needs to broadcast in order to coordinate n parties, each with 
only local information about a problem instance, to jointly implement a globally optimal solution. Unlike 
in communication complexity, there is no need for the communication protocols in our setting to derive 
the optimal solution starting with nothing but local information, nor even verify that a proposed solution 
is optimal (as is the goal in non-deterministic communication complexity). Instead, in our setting, there is 
a central coordinator who already has complete knowledge of the problem instance — and hence also of 
the optimal solution. His goal is simply to publish a concise message to guide the n parties making up the 
problem instance to coordinate on the desired solution — ideally using fewer bits than would be (trivially) 
needed to simply publish the optimal solution itself. * 

Aside from its intrinsic interest, our motivation for studying this quantity is two-fold. First, as we 
show, problems with low coordination complexity also have good protocols for implementing nearly optimal 
solutions under the constraint of joint differential privacy [DMNS06, KPRU14] — i.e. protocols that allow 
the joint implementation of a nearly optimal solution in a manner such that no coalition of parties can learn 
much about the portion of the instance known by any party not in the coalition. The existence of jointly 
differentially private protocols in turn have recently been shown to imply a low “price of anarchy” for no¬ 
regret players in the strategic variant of the optimization problem when the game in question is smooth — 
even when the population is dynamically changing [LST15]. Hence, as a result of the connection we develop 
in this paper, in order to show dynamic price of anarchy bounds of the sort given in [LST15], it is sufficient 
to show that the game in question has low coordination complexity, without needing to directly develop 
and analyze differentially private algorithms. Using this connection we also derive new results for what can 
be implemented under the constraint of pure joint differential privacy — results that were previously only 
known subject to approximate joint differential privacy. 

Second, coordination complexity is a stylized measure of the power of concise broadcasts (e.g. prices in 
the setting of allocation problems, or congestion information in the setting of routing problems) to coordinate 
populations in the absence of any interaction.- Here we note that prices seem to coordinate markets, despite 
the fact that individuals do not actually participate in any kind of interactive “Walrasian mechanism” of 
the sort that would be needed to compute the allocation itself, in addition to the prices (see e.g. [KC82, 
DN014]). Indeed, prices alone are generally not sufficient to coordinate high welfare allocations because 
prices on their own can induce a large number of indifferences that might need to be resolved in a coordinated 
way — and hence Walrasian equilibria are defined nof jusf as vectors of equilibrium prices, buf as vecfors 
of prices paired wifh opfimal allocations. Publishing a Walrasian equilibrium would be a frivial solufion in 
our selling, because if involves communicaling Ihe entire solufion lhal we wish fo coordinate — Ihe optimal 
allocafion. Neverfheless, we show fhal Ihe coordinafion complexify of fhe allocalion problem is — up to 
log faclors — equal lo Ihe number of fypes of goods in a commodify markel. This is fhe same as whaf 
would be needed lo communicafe prices (indeed, our solufion can be viewed as communicating prices in 
a slighlly differenl, “regularized” markel), and can be subslanlially smaller lhan whaf would be needed lo 
communicafe fhe optimal allocafion ilself. 

'within our framework of coordination complexity, we assume that the players are not strategic — they will faithfully follow the 
coordination protocol upon observing the message broadcast by the coordinator. We do study the interface between the coordination 
complexity and the strategic variants of some problems in Section 5. 

^Of course, the connection here is in a stylized model — in a market, there is not in fact any party with complete information of 
the problem instance — but the market is nevertheless encoding good “distributional information” about the population of buyers 
likely to arrive. 
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1.1 Our Results and Techniques 

In our model (which we formally define in Section 2), a problem instance D is defined by an n-tuple from 
some abstract domain X: D € We write D = , ..., to denote the fact that the information 

defining the problem instance is partitioned among n agents, and each agent i knows only his own part 
The solution space is also a product space: and each agent i can choose a single action Oi & A 

- the choices of all of the agents jointly form a solution a = (ai,... , 0 ^). The coordinator knows the 
entire problem instance D, and publishes a signal (j{D) G {0,1}^. Each agent then chooses an action 
ai := vr (!)(*) 

,a{D)) based only on the coordinator’s signal and her own part of the problem instance. The 
jointly induced solution a = (ai,..., an) is the output of the interaction. The pair of functions a, vr jointly 
form a protocol, and i, the length of the coordinator’s signal is the coordination complexity of the protocol. 
The coordination complexity of a problem is the minimal coordination complexity of any protocol solving 
the problem. 

A canonical example to keep in mind is many-to-one matchings: Here, a problem instance is defined 
by a bipartite graph between n agents and k types of goods. Each good j has a supply sj, and the goal 
is to find a maximum cardinality matching such that no agent is matched to more than one good, and no 
good j is matched to more than sj agents. Here, the portion of the instance known to agent i is the set 
of goods adjacent to agent i- but nothing about the goods adjacent to other agents. Note that describing a 
matching requires n(nlog k) bits, which is the trivial upper bound on the coordination complexity for this 
problem. Eor this problem, we show nearly matching upper and lower bounds: no protocol with coordination 
complexity o{k) can guarantee a constant approximation to the optimal solution, whereas there is a protocol 
with coordination complexity 0{k log n) that can obtain a (1 + o(l))-approximation to the optimal solution. 
Our upper bound in fact extends much more generally, to any problem that can be written down as a convex 
program whose objective and constraints are linearly separable between agents’ data. 

The idea of the upper bound is to broadcast a portion of the optimal dual solution to the convex program 

- one dual variable for every constraint that is defined by the data of multiple agents (there is no need to 
publish the dual variables corresponding to constraints that depend only on the data of a single agent). Eor 
the many-to-one matching problem, these dual variables correspond to “prices” - one for each of the k types 
of goods. This idea on its own does not work, however, because a dual optimal solution to a convex program 
is not generally sufficient to specify the primal optimal solution. When specialized to the case of matchings, 
this is because optimal “market clearing prices” can induce a large number of indifferences among goods 
for each of the n agents, and these indifferences might need to be broken in a coordinated way to induce an 
optimal matching. To solve this problem, we instead release the dual variables corresponding to a slightly 
different convex program, in which a strongly convex regularizer has been added to the objective. The effect 
of the strongly convex regularizer is that the optimal dual solution now uniquely specifies the optimal primal 
solution - although now the optimal primal solution to a modified problem. The rest of our approach deals 
with trading off the weight of the regularizer with the number of bits needed to approximately specify each 
of the dual variables, and the error of the regularized optimal solution relative to the optimal solution to the 
original problem. 

We also give several other positive results, based on a different technique: broadcasting the truncated 
transcript of a process known to converge to a solution of interest. Using this technique, we give low 
coordination complexity protocols for the problem of coordinating on an equilibrium in a routing game, and 
for the problem of coordinating on a stable many-to-one matching. 

Einally, we show that problems that have both low sensitivity objectives (as all of the problems we 
study do) and low coordination complexity also have good jointly dijferentially private protocols. Using the 
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results of [LST15], this also shows a bound on the price of anarchy of the strategic variant of these problems, 
whenever they are smooth games, which holds even under a dynamically changing population. 

1.2 Related Work 

Our model of coordination complexity is related to, but distinct from, the well-studied notion of commu¬ 
nication complexity — see [KN97] for a textbook introduction. While both complexity notions measure 
the number of bits that must be transmitted among decentralized parties to reach a particular outcome, they 
differ in the initial endowment of information, as well as in the requirements of each player to know the 
final outcome. In communication complexity, the information describing the problem instance is fully dis¬ 
tributed, and communication is necessary for all parties to know the outcome. Coordination complexity in 
contrast assumes the existence of a coordinator who knows the entire problem instance, and must broadcast 
information to the players which will allow them to each compute their part of the output - there is no need 
for any of the parties to know the entire output. More similar to our setting is non-deterministic commu¬ 
nication complexity, in which we may imagine that there is an oracle who knows the inputs of all players 
and broadcasts a message (perhaps partially) describing a solution together with a certificate that allows the 
parties to verify the optimality of the solution. In contrast, in our model of coordination complexity, the 
coordinator does not need to provide any certificate allowing parties to verify that the coordinated solution 
is optimal (indeed, each party need not have any information about the portion of the solution proposed to 
other parties). 

The informational requirements of coordinating matchings has a long history of study in economics, 
and has recently gained attention in theoretical computer science. Hayek’s classic paper [Hay45] conjec¬ 
tured that Walrasian price mechanisms, which coordinate matchings via a tatonnement process that updates 
market-clearing prices based on demand, are “informationally efficient,” in that they verify optimal alloca¬ 
tions with the least amount of information. This was later formalized by [Hur60] and [MR74] in specific sef- 
fings of inferesf, using an informafional mefric fhaf measured smoofh real-valued communicafion. Nisan and 
Segal sfudy fhe communicafion complexify of mafchings using fhe fools of communicafion complexify as 
developed in computer science, and show fhaf any communicafion profocol fhaf defermines an optimal allo¬ 
cation musf also determine supporting prices [NS06]. Recenfly, [DN014] and [ANRW15] sfudied fhe prob¬ 
lem of compufing an opfimal mafching fhrough fhe lens of inferacfive communicafion complexify, showing 
fhaf inferacfive protocols can have significanlly lower communication complexify fhan non-inferacfive ones. 
Nofe fhaf fhe communicafion complexify bounds given in fhese papers are always larger fhan fhe descripfion 
lengfh of fhe mafching ifself - in confrasf, here when we sfudy coordinafion complexify, nonfrivial bounds 
musf nof jusf be smaller fhan fhe inpuf, buf musf also be smaller fhan fhe size of fhe opfimal mafching. 

Finally, fhere are fwo papers fhaf sfudy a very similar selling to ours, allhough Ihey oblain ralher differenl 
resulls.^ Calsamiglia [Cal84] sludies a real-valued communicafion model in which a cenlral coordinalor wilh 
full knowledge of fhe insfance needs to broadcasl a concise signal to coordinate an allocafion in an exchange 
markel—see [Seg06] for conlexl on how Ihis resulf fils info fhe economic lileralure on communicafion 
complexify. Deng, Papadimilriou, and Safra also sfudy a similar model in Section 4 of [DPS02], which Ihey 
call “Markel Communicafion”. Despite fhe similarity in models, fhe resulls of bolh [Cal84] and [DPS02] 
sfand in sharp confrasf fo ours—fhey bolh give lower bounds, showing fhaf fhe amounf of communication 
necessary needs lo grow linearly wilh fhe number of buyers n, while we give upper bounds showing fhaf 
if is necessary fo grow only wilh fhe number of differenl types of goods k. Calsamiglia does nof allow 
approximation in his model, which is necessary for our resulls. Deng, Papadimilriou, and Safra allow for 

^We thank Ilya Segal for pointing out [Cal84] to us, and thank Sepehr Assadi for pointing out Section 4 of [DPS02]. 
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approximation, but study an instance of a problem that cannot be expressed as a linearly separable convex 
program, which shows that structure of the sort that we use is necessary. 

A line of work [KPRU14, RR14, CKRW14, HHR+14, HHRW14, RRUW15] has studied protocols 
for implementing outcomes in various settings under the constraint of joint differential privacy [DMNS06, 
KPRU14], which allows n parties to jointly implement some solution while ensuring that no coalition of 
parties can learn much about the input of any party outside the coalition. Most (but not all) of these algo¬ 
rithms are actually private coordination protocols of the sort we study here, in which the algorithm can be 
viewed as a coordinator who is constrained to broadcast a private signal. These jointly private algorithms 
are not constrained to transmit a short signal - and indeed, the private signals can sometimes be verbose. 
But as we show, problems with low coordination complexity also have good jointly differentially private 
algorithms, which was one of our original motivations for studying this quantity. 

Lykouris, Syrgkanis, and Tardos [LST15] show that the existence of a jointly differentially private algo¬ 
rithm for solving an optimization problem implies that the strategic variant of the problem has a low “price 
of anarchy” for learning agents, even in dynamic settings, in which player types change over time, as long 
as the game is smooth. Because we show in Section 5 that any problem with a low sensitivity objective 
and low coordination complexity has a good jointly differentially private algorithm, using the results of 
[LST15], to prove a bound on the price of anarchy in a smooth dynamic game, we show it suffices to bound 
the coordination complexity of the game. 

2 Preliminaries 

A coordination problem is defined by a set of n agents, a data domain X, an action range A, and a social 
objective function S: x A^ —^ M. An instance of a coordination problem consists of a set of n elements 

from the data domain: D = (DA) ^^ £ X^. Each agent i has knowledge only of DA^ his own 

portion of the problem instance, and the goal is for a centralized coordinator to broadcast a concise message 
to the agents to allow them to arrive at a solution a = (oi,..., a„) G A^ that approximately maximizes the 
objective function S{D,a). 

A coordination protocol consists of two functions, an encoding function a : X"^ —)• {0,1}* and a decod¬ 
ing function it: X X {0, 1}* —)• ,4.. A coordination protocol (cr, vr) proceeds in two stages: 

• First the coordinator broadcasts the message (t{D) to all agents using the encoding function. 

• Then each agent selects an action a* on the basis of her own portion of the problem instance and the 
broadcast message, using the decoding function: a* := t:{dA ^ a{D)). 

Both functions a and vr may be randomized. The approximation ratio of a protocol is the ratio of the 
optimal objective value to the expected objective value of the solution induced by the protocol, in the worst 
case over problem instances. 

Definition 1 (Approximation Ratio). A coordination protocol (cr, vr) obtains a p approximation to a problem 

if-' 

OFT(D) 

where each a* = 7t{DA ^cr{D)), and the expectation is taken over the randomness of a and tt. 

The coordination complexity of a protocol is the maximum number of bits the encoding function broad¬ 
casts, in the worst case over problem instances. 
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Definition 2 (Coordination Complexity), A coordination protocol {a, vr) has coordination complexity i if: 

max \a(D)\ = i. 

The coordination complexity of obtaining a p approximation to a problem is the minimum value of the 
coordination complexity of all protocols {a, vr) that obtain a p approximation to the problem. 

We conclude by making several observations about coordination protocols. First, as we have defined 
them, they are non-interactive - the coordinator first broadcasts a signal, and then the agents respond. This is 
without loss of generality, since the coordinator has full knowledge of the problem instance. Any interactive 
protocol could be reduced at no additional communication cost to a non-interactive protocol, simply by 
having the coordinator publish the transcript that would have arisen from the interactive protocol. This is in 
contrast to the setting of communication complexity, in which interactive protocols can be more powerful 
than non-interactive protocols (and makes it easier to prove lower bounds for coordination complexity). 

Second, the coordination complexity of a problem is trivially upper bounded both by the description 
length of the problem instance (as is communication complexity), and by the description length of the 
problem’s optimal solution (unlike in non-deterministic communication complexity, there is no need to pair 
the optimal solution with a certificate allowing individual agents to verify it). Hence, non-trivial bounds will 
be asymptotically smaller than both of these quantities. 

Bipartite Matching The primary coordination problem we study in this paper is the bipartite matching 
problem. In this problem, there is a bipartite graph G = {V, W, E), in which every node in V is associated 
with a player and every node in W represents a good. Each player i’s private data is the set of edges 
incident to her node - i.e. = {j : {i,j) £ E}. We study two variants of this problem. In the one- 
to-one matching problem, W represents a set of distinct goods, and the goal is to coordinate a maximum 
cardinality matching E' C E such that for every i G H, |{j G FF : (i, j) G E'}\ < 1 and for every j G W, 
\{i £ V : {i,j) £ E'}\ < 1- Iri the many-to-one matching problem, W represents a set of k commodities j, 
each with a supply bj. The goal is to coordinate a maximum cardinality many-to-one matching E' C E such 
that for every i £ V, \{j £ W : {i,j) £ E'}\ < 1 and for every j £ W, \{i £ V : {i,j) £ E'}\ < bj. The 
social objective in this setting is the welfare or the cardinality of the matching, and we will use OPT(G) to 
denote the optimal welfare objective. 

Note that the resulting solution might not be feasible since the players’ demands are not always satisfied. 
We need to make sure that we are not over-counting when measuring the welfare. In one-to-one matchings, 
if more than one players select a good, only the first player is matched to it. In many-to-one matchings, if 
more than bj players select a good of type j, only the first bj players are matched the good j. 

Notation We use || • || to denote the £2 norm, and more generally use || • ||p to denote the £p norm. 

3 Lower Bounds for Bipartite Matchings 

In this section, we present lower bounds on the coordination complexity of bipartite matching problems. As 
a building block, we prove a lower bound for the one-to-one matching problem on a bipartite graph with n 
vertices on each side, showing an Q{n) lower bound - i.e. that no substantial improvement on the trivial 
solution is possible. We then extend this lower bound to the problem of many-to-one matchings, in which 
there are n agents who must be matched to k goods (each good can be matched to many agents, up to its 
supply). Here, we show an Q{k) lower bound. In the next section, we give a nearly matching upper bound, 
which substantially improves over the trivial solution. 
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3.1 A Variant of the Index Function Problem 


Before we present our lower bound, we introduce a variant of the random index function problem [KNR99], 
which will be useful for our proof. 

MULTIPLE-INDEX There are two players Alice and Bob. Alice receives as input a sequence of t pairs, 

I = {{Si, Ui) : i = 1,2,, f), where the Si are disjoint sets each with k elements, and Ui is uniformly 
distributed in Si. Based on her input Alice sends Bob a message M{I). Bob then receives {Sj,j), where j 
is chosen from [f]. Bob must determine Uj', let his output be B{Sj,j, M{I)) G Sj. We say that the protocol 
succeeds if B{Sj,j,M{I)) = uj. Let i{t, k,p) be the minimum number of bits (for the worst input) that 
Alice must send in order for Bob to succeed with probability at least p. 

Note that if Bob guesses randomly, then the protocol already succeeds with probability p = 1/k. The 
following result shows that any significant improvement over this trivial probability of success will require 
Alice to send Bob a long message. See appendix for a full proof. 

Lemma 1. For p > l/k, we have i{t, k, p) > (8 log e)t{p — 1/fe)^. 

3.2 Lower Bound for One-to-One Matchings 

We will first focus on the lower bound on one-to-one matching and show the following. 

Theorem 1. Suppose the coordination protocol If/or one-to-one matching guarantees an approximation 
ratio of p in expectation. Then, the coordinator of II must broadcast ^(n/p^) bits on problem instances of 
size n (in the worst case). 

Fix the protocol Tl. We will extract a two-party communication protocol for the MULTIPLE-INDEX 
problem from 11, and use the above lemma. As a first step for our lower bound proof, we will consider the 
following random graph construction process RanG. 

Random Graph Construction RanG(p, n): Let ^ and A = Consider the following random 
bipartite graph G with vertex set {V, W) such that \V\ = \W\ = n. 

• Randomly generate an ordering wi,W 2 ,.. ■ ,Wn of lU (all n! orderings being equally likely), and 
partition VF as VFi U W 2 such that Wi = {wi,W 2 ,..., w^j, and W 2 = { 10 ^+ 1 , Wk+ 2 , ■ ■ ■, u^n}- 

• Similarly, randomly generate an ordering vi,V 2 ,... ,VnOfV, and parition V into n/A bocks, Bi, B 2 ,..., B^/a 
(each with A vertices), where 


Bj := {vi : {j - l)A -\-l <i < j A}. 

• Connect Bj and W as follows. First, we describe the connections between V and Wi. The neigh¬ 
bourhoods of the vertices in each Bj will be disjoint: we partition Wi into equal-sized disjoint sets 
{Ty : V G Bj), and let the neighbours of u G Bj be exactly the 2p vertices in Ty. 

• In addition, assign each vertex in v one neighbor in W2, by connecting V with W2 in round-robin 
fashion — connect vertex Vi to vertex Wj, where j = {n-Ii mod {n — k)). 

Before we prove Theorem 1, let us first observe that a graph generated by RanG always has a matching 
with high welfare. 
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Lemma 2. Each graph G generated by the above process RanG(-, n) has optimal welfare OPT(G) > 
Proof. Given the fixed ordering over the vertices in V, match each of its first (1 — ^)n vertices to its unique 
neighbor in W 2 . Since p > 1, this gives a matching with welfare at least fl — □ 


Proof of Theorem 1. Let If be a coordination protocol with coordination complexity (. and approximation 
ratio p. This means that on a graph instance generated by RanG, the parties can coordinate on a matching 
with expected weight at least 0. Since \ Wi\ = |^, we know in expectation at least 0 — ^ = 0 of the 
vertices in W 2 are matched. Let be the probability that in 11, agent v picks her neighbor in W 2 . Then, 
by linearity of expectation, that is, Et,gy[a^] > Hence, there must be some block Bj 

such that [(^v\ > f ■ We will now restrict attention to the block Bj and consider the following instance 

of MULTIPLE-INDEX: for each v G Bj, set Sy = N{v )—the neighborhood of vertex v, and let Uy be 
the vertex unique vertex in Sy n W 2 . Since the message broadcast by the coordination protocol allows the 
players to identify the special element with average success probability of by Lemma 1 the length of 
message 


> (Sloge 


n 

16 ^ 


1 


Ap 2p+l 


>n{ ^ 


A / ’ 


which completes the proof. 


□ 


3.3 Lower Bound for Many-to-One Matchings 

Finally, we give the following lower bound on coordination complexity for many-to-one matchings. The 
lower bound relies on the result from Section 3.2— we show that any coordination protocol for many-to-one 
matchings can also be reduced to a protocol for one-to-one matchings, and so the lower bound in Section 3.2 
can be extended to give a lower bound for the many-to-one setting. 

For our lower bound instance, we consider bipartite graphs G = {V, E) such that the vertices in V 
represent n different players and W represent a set of k goods j, each with a supply b. 

Theorem 2. Suppose that there exists a coordination protocol for many-to-one matchings that guarantees 
an approximation ratio of p in expectation. Then such a protocol has coordination complexity ofElfk/p'^). 

We will start by considering a one-to-one matching instance generated by RanG with k vertices on each 
side of the graph G' = {V', W, E'). By Lemma 2, the optimal matching of G' has size OPT' > 

Now we will turn this into an instance of a many-to-one matching problem: make b copies of each vertex 
in V' to obtain vertex set V, and set VF := W' such that the supply of each good j is 6; then for an edge 
(f', w') in the original graph, connect all copies of v' to w' in the new graph. This gives a bipartite graph 
G = {V,W,E). The following claim is straightforward. 

Claim I, The new graph G has a matching of size at least (b OPT'). 

Now suppose that we could coordinate the players in V to obtain a matching M* of size in G. 

Then with a simple sampling procedure, we can extract a high cardinality matching for the original graph: 
for each vertex in v' G V, sample one of the b copies of v' in G uniformly at random along with its incident 
matched edge. If two vertices in V are connected to the same type of good in W, break ties arbitrarily and 
keep only one of the edges. 
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Lemma 3. The sampled matching in G' has expected size at least . 

We will defer the proof to the appendix. We now have all the pieces to prove Theorem 2. 

Proof of Theorem 2. Suppose that there exists a coordination protocol (cr, vr) for many-to-one matchings 
with a guaranteed approximation ratio of p. By the result of Lemma 3, we know that this coordination 
protocol for one-to-one matchings has an approximation ratio most 0{p). By the lower bound in Theorem 1, 
we know that the length of (t{G) is at least U.{k/p^). □ 

4 Coordination Protocol for Linearly Separable Convex Programs 

In this section, we give a coordination protocol for problems which can be expressed as linearly separable 
convex programs, with coordination complexity scaling only with the number of constraints that bind be¬ 
tween agents (so called coupling constraints, defined below). In the next section, we show how to specialize 
this protocol to the special case of many-to-one matchings, which gives coordination complexity nearly 
matching our lower bound. 

Definition 3. A linearly separable convex optimization problem consists ofn players and for each player i, 

• a compact and bounded convex feasible set C E | ||x(*)|| < 1}, 

• a concave objective and 1-Lipschitz function —>■ M such that = 0, 

• and k convex constraint function [0,1] (indexed by j = 1,... ,k). 

The convex optimization problem is: 

n 

maxy^ 

X ^ 

i=l 

n 

subject to < hj for j = 1,... ,k (Coupling constraints) 

i=\ 

xb) £ jrb) fori = 1,... ,n (Personal constraints) 
where each player i controls the block of decision variable 

Viewed as a coordination problem, the data held by each agent i is ..., his 

action range is Ai = and the social objective function is S the objective of the convex program. 

We will denote the product of the personal constraints by x ... x the objective function 

by v{x), and the optimal value by OPT. In this notation we can write the problem as 

max v{x). 

xdT and for all j 

Note that here the problem is constrained both by the personal constraints F and by the coupling constraints. 
We will assume the problem above is feasible and our goal is coordinate the players to play an aggregate 
solution X = that is approximately feasible and optimal. Our solution consists of two steps: 



1. We will first introduce a regularization term r/||x|p to our objective function, and coordinate the 
players to maximize the regularized objective. The purpose of adding this regularization term is to 
make the objective function strongly concave, which will cause it to have the property that an optimal 
dual solution will uniquely specify the optimal primal solution. 

2. Then we will show that the resulting optimal solution to the regularized problem is close to being 
optimal for the original (unregularized) problem. The weight of the regularization has to be traded off 
against the bit precision to which we need to communicate the optimal dual variables. 

4.1 Coordination through Regularization 

In the first step, we add a small regularization term to our original objective function. Consider the following 
convex optimization problem: 


n 

If \ V ('/')/ (7'\ \ ^11 Il2 

max V [x) = “ ttII^II 

and for aW j ^ 


Claim 2. The objective function v' is rj-strongly concave. 

To solve the convex program, we will work with the partial Lagrangian C{x,X), which results from 
bringing only the coupling constraints into the objective via Lagrangian dual variables, but leaving the 
personal constraints to continue to constrain the primal feasible region: 


X{x,X) = 

i=l 


i=i 


^2=1 



E 

2=1 




i=i 


i=l 


Let OPT' denote the optimum of the convex program, and by strong duality we have 


max min Cfx, A) = min maxC(x, A) = OPT' 
AeR^- AsK^. 

Fixing the optimal dual variables. A, the optimal primal solution y satisfies 


y = argmaxC(x, A) 

Note that the result of moving the coupling constraints into the Lagrangian is that we can now write the 
primal optimization problem over a feasible region defined only by the personal constraints. Because of 
this fact, and because the Lagrangian objective is linearly separable across players, given A, each player’s 
portion of the solution ?/(*) is 


argmax 

x&Ti 





k 



i=i 



( 1 ) 
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Thus, if the argmax were unique, this means that the optimal dual variables A would be sufficient to 
coordinate each of the parties to find their portion of the optimal solution, without the need for further 
communication (the problem, in general, is that the argmax need not be unique, and ties may need to be 
broken in a coordinated fashion). However, because we have added a strongly concave regularizer, the 
argmax is unique in our setting: 

Claim 3. The solution to 

argmax ^ Aj (c 

j=i Vi=i / 

is unique. 

Proof. This follows from the fact that the function ^(*) 

IP is Strongly concave. □ 

This gives rise to our simple coordination mechanism ReC. The mechanism first computes the optimal 
dual variables in our regularized partial Lagrangian problem, rounds them to finite precision, and then pub¬ 
lishes these variables. Then each individual player finds her parf of the near optimal solution by performing 
the optimization in Equation (1). The details are in Algorithm 4.1. 


Algorithm 1 Coordination Protocol for Linearly Separable Convex Programs ReC(r/, e) 

Input: a linearly separable convex program instance I, regularization parameter q and target accuracy e 
2 

Initialize: a = 

4v nk 

Modify the objective of I into 


maxxfx) 


7/||x|P 

2 


Compute the optimal dual solution A* for the modified convex program 
Round each coordinate of A* into a multiple of a/ s/k and obtain A 
Broadcast the rounded dual solution A. To decode, each player i computes: 

(A) = argmax 

x&Ti 



Next we show that the resulting solution is close to the optimal solution of the regularized convex 
program (i.e. that we do not lose much by truncating the dual variables to have finite bit precision). Let 
(x*, A*) be an optimal primal-dual pair for the regularized convex program. Note that since the objective of 
the program is strongly concave, x* is unique. Lirst, we will show that if the broadcast dual vector A is close 
to an optimal dual solution A*, the resulting solution x will also be close to the optimal primal solution x*. 

Lemma 4. Suppose we have a dual vector A such that ||A* — A|| < a. Let x = argmax^gjr C{x, A), then 

II- .11 ^ 2^/a{nk)^/* 

||x — X II < - 
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The proof relies on some basic properties of the Lagrangian and strong concavity and is deferred to the 
appendix. 

Lemma 5. The coordination mechanism ReC instantiated with regularization parameter rj and target ac¬ 
curacy parameter e will coordinate the players to play a solution x that satisfies ||a; — x*|| < e, and has a 
coordination complexity of 0{k\og{nk/pe)). 

2 

Proof. Note that a = and the mechanism rounds each coordinate of the optimal dual solution A* to a 

multiple of ajs/k, so the approximate dual vector A can be specified with 0{k \og{\/k/a)) bits. 

Since for each coordinate j, |A* — \j\ < ajy/k, we also have that that ||A* — A|| < a. By Lemma 4, we 
know that ||x — x*|| < e. □ 

4.2 Approximate Feasibility and Optimality 

Now we carry out the second step to show that if we choose the regularization parameter p carefully, the 
solution resulting from the coordination mechanism above is both approximately feasible and optimal. Let 
X* denote the optimal solution of the original convex program, x* denote the optimal solution of the regu¬ 
larized convex program, and x{p) denote the solution resulting from the coordination mechanism when we 
use parameter p. 

As an intermediate step, we will first bound the objective difference between x* and x*. 

Lemma 6. For any choice ofp, v{x*) — v(x*) < 

Proof Since both x* and x* are in the feasible region of the regularized convex program, we know that 

v[x )- \\x > v(x )- \\x . 

Since for each i, (x*)^^^ has £2 norm bounded by 1, then ||a;*|p — < n. Therefore, we must 

have v(x*) > v(x*) — ^ □ 

Next we bound the objective difference between x and x* using Lipschitzness. 

Lemma 7. Suppose that ||x — x*|| < e, then 

v{x*) — v(x) < ne. 

Proof The proof follows easily from the fact that each is 1-Lipschitz and the function v is n-Lipschitz 
in the aggregate vector x. □ 

Theorem 3. The coordination mechanism ReC{p, e) coordinates the players to play a joint solution x that 
satisfies 

v(x) > OPT —n(e + p) and min ||x — x\\ < e 
and has coordination complexity of 0{k\og{nk / pe)). 

Proof Follows easily from the previous lemmas. □ 
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4.3 Application to Many-to-One Matchings 

Next we show a simple instantiation of our coordination mechanism for linearly separable convex programs 
to give a coordination complexity upper bound for many-to-one matchings. First, let’s consider the following 
linear program formulation of the matching problem. 


n k 




(2) 

i=l j=l 



71 

subjecl fo Xij < bj for j = 1,..., /c 

i=l 


(3) 

k 

"^Xij <1 for j = 1,... ,/c 


(4) 

i=i 



Xij >0 for z = 1,..., n and j = 1,.. 

.,k 

(5) 


Observe that the matching linear program is an example of a linearly separable convex program as 
defined in Definition 3. Each player i has valuation Vi^j G {0,1} for each type of good j and controls the 
decision variables Each supply constraint in Equation (3) corresponds to a coupling constraint, 

and constraints in both Equation (4) and Equation (5) are personal constraints. 

A nice property about the matching linear program is that any extreme point is integral. However, this 
structure no longer holds if we add a regularization term to the welfare objective, so the resulting solution x 
resulting from the coordination mechanism will be fractional. To obtain an integral solution, we can simply 
use independent rounding, which does not require any further coordination. In order to obtain an integral 
solution, each player i will take their portion of the fractional solution {xij)j^i and will independently 
sample a good by selecting each good j with probability Xij. We will continue to use similar notation: let 
?;(•) denote the welfare objective in the linear program, let x* be the optimal solution for the matching linear 
program with welfare OPT, x be the optimal solution for the regularized program with welfare V, x' be 
the rounded solution of x, and let F denote the feasible region defined by all fhe consfrainfs of Equation (3) 
in fhe linear program. The following lemma bounds fhe loss of welfare due fo rounding. Eor defails of fhe 
proof, see fhe full version. 

Lemma 8. Let (3 G (0,1). Then with probability at least 1 — /3, the rounded solution x' satisfies 

j V 


Proof. Since E 





V, by Chernoff-Hoeffding bound, we know fhaf for any 6 G (0,1), 


Pr 




i=l j=l 


< exp ( —6^V /2 


If we sef = exp(—/2), fhen we gel 6 = y 2 log(l//3) jV, which recovers fhe slated bound. 
Now we look af approximate feasibilily of x'. 


□ 
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Lemma 9. Suppose that ||x — x|| < e. Then with probability I — (3, x' satisfies 



X• j < \J‘ik\og{k/j3)V + Vnke 


/ + 

Observe that since this is a packing linear program, if desired, it is easy to obtain exact feasibility by 
simply scaling down the supply constraints: this transfers the approximation factor in the feasibility bound 
to the become an approximation factor in the objective. 

Lastly, we are ready to establish the welfare guarantee for the rounded solution. Since the solution we 
obtain might slightly violate the feasibility constraints, we want to make sure we are not over-counting. If 
more than bj parties select a particular good of type j, we only count the first bj parties to select it when 
measuring our welfare guarantee. 

Theorem 4. There exists a coordination protocol with coordination complexity 0{k log(n/c)) such that the 
parties coordinate on a matching x' with total weight: 


k 

E 

j = l 


mm 


E 

. i=l 




> 1-0 


\/klog(k//3) 

s/OPT 


OPT 


as long as OPT > 1. 


Observe that in the setting of many-to-one matchings, when the supply of each good is Sj >> 1, we 
expect that OPT S> k, and hence in this setting, the above theorem guarantees a solution with weight 
(l-o(l))OPT. 

Remark 1. We remark that many other combinatorial optimization tasks have fractional relaxations that 
can be written as linearly separable convex programs, and the same rounding technique can be applied 
to get low-coordination-complexity protocols for them. This class includes among others multi-commodity 
flow (where the coordination complexity scales with the number of edges in the underlying graph, but not 
with the number of parties who wish to route flow) and multi-dimensional knapsack problems (where the 
coordination complexity scales with the number of different types of knapsack constraints, but not with the 
number of parties who need to decide on their inclusion in or out of the knapsack). 


5 Interface with Privacy and Efficiency in Games 

In this section, we explain a simple implication of our results: Problems that have low sensitivity objectives 
(i.e. problems such that one party’s data and action do not substantially affect the objective value) and low 
coordination complexity also have good algorithms for solving them subject to joint differential privacy. 
When the strategic variant of the optimization problem is a smooth game, they also have good welfare 
properties for no-regret players, even when agent types are dynamically changing. 

5.1 Privacy Background 

A database D G is an n-tuple of private records, each from one of n agents. Two databases D,D' are 
i-neighbors if they differ only in their f-th index: that is, if Dj = D'- for all j i. If two databases D and 
D' are z-neighbors for some i, we say that they are neighboring databases. We write D ~ D' to denote that 
D and D' are neighboring. We will be interested in randomized algorithms that take a database as input, 
and output an element from some abstract range TZ. 
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Definition 4 ([DMNS06]). A mechanism A4: —)• TZ is (e, (5)-differentially private if for every pair of 

neighboring databases D, D' G Af” and for every subset of outputs S fTZ, 

Pr[AA(D) G 5] < exp(e) Pr[M{D') G 5] + (5. 

For the class of problems we consider, elements in both the domain and the range of the mechanism are 
partitioned into n components, one for each player. In this setting, yo/nt differential privacy [KPRU14] is a 
more natural constraint: For all i, the joint distribution on outputs given to players y 7 ^ i is differentially pri¬ 
vate in the input of player i. Given a vector x = (xi ,..., x^), we write x-i = (xi ,..., Xj_i , Xj+i ,..., Xn) 
to denote the vector of length (n — 1 ) which contains all coordinates of x except the i-th coordinate. 

Definition 5 ([KPRU14]). A mechanism M. : is (e, (f)-jointly differentially private if for every i, 

for every pair of i-neighbors D,D' ^ X'^, and for every subset of outputs S C 

Pr[7W(L»)_i G 5] < exp(e) Pr[7W(L»')-i G 5] + 5. 

If 5 = 0, we say that Ai is e-dijferentially private. The case of 5 > 0 is sometimes referred to as approximate 
differential privacy. 

Note that this is still a very strong privacy guarantee; the mechanism preserves the privacy of any player i 
against arbitrary coalitions of other players. It only weakens the constraint of differential privacy by allowing 
player i’s output to depend arbitrarily on her own input. 

An important class of jointly differentially private algorithms - particularly amenable to our purposes - 
are those that work in the so-called billboard model. Algorithms in the billboard model compute a differen¬ 
tially private signal as a function of the input database; then each player Fs portion of the output is computed 
as a function only of this private signal and the private data of player i. The following lemma shows that 
algorithms operating in the billboard model satisfy joint differential privacy. 

Lemma 10 ([HHR+14]). Suppose A4 : X^ —>■ TZ is (e, 6)-differentially private. Consider any set of 
functions fi'.XxTZ^ TZ'. Then the mechanism M' that outputs to each player i: fi{Di,M{D)) is 
(e, 5)-jointly differentially private. 

Note the similarity between algorithms operating in the billboard model and coordination complexity 
protocols: a signal is computed by a central party, and then the action of each agent is a function only of this 
signal and of their own portion of the problem instance. Thus, the following lemma is immediate: 

Lemma 11. A coordination protocol {a, vr) satisfies (e, 5)-joint differential privacy if the coordinator’s 
encoding function a satisfies (e, 6)-differential privacy. 

Proof. Follows from Lemma 10. □ 

5.2 A Generic Private Coordination Protocol 

Next, we give a general way to convert any coordination protocol to a jointly differentially private algorithm 
- and the lower the coordination complexity of the protocol, the better the utility guarantee of the private 
algorithm. The tool we use is the exponential mechanism of [MT07], one of the most basic tools in differ¬ 
ential privacy. To formally define this mechanism, we consider some arbitrary range TZ and some quality 
score function q: A” x 7^ —)• M, which maps database-output pairs to quality scores. 
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Definition 6 (The Exponential Mechanism [MT07]), The exponential mechanism M-e{D, q, TZ, e) selects 
and outputs an element r gTZ with probability proportional to 


exp 


( £(l{D,r)\ 

V 2 A(g) J 


where 


A(7) 


max 


\qiD)-q{D% 


McSherry and Talwar showed that the exponential mechanism is private and with high probability selects 
an outcome with high quality. 


Theorem 5 ([MT07]). The exponential mechanism AiE{',<l,'TZ,^)^citisfies {e,0)-differential privacy, and 
for any D G it outputs an outcome r gTZ that satisfies 


Q{D,r) > maxq{D,r') 

r' 


2A(g)(log(|7^|//3)) 

e 


with probability at least 1 — fi. 

Using the exponential mechanism, we can take any coordination protocol (cr, vr), and construct a jointly 
differentially private coordination protocol (cr',7r) with the same coordination complexity, and almost the 
same approximation factor. The idea is to construct a differentially private encoding function a' that selects 
from the message space of a using the exponential mechanism. Without loss of generality, we assume that 
the social objective function S has low-sensitivity: 

max max max \S(D,a) — S((Dj,D-i),(a'j,a-i))\ < 1.^ 
i&[n]a&A^,D&X^areAi,DleX 

Now we present the private protocol as follows: 


Algorithm 2 Jointly private algorithm PriCoor(((T, vr), q, s, D) 

Input: A coordination protocol (cr, vr), objective function /, and input instance D 
Let TZ = {a{D') \ D' G be the space of all possible messages in the range of a 
Let quality function q be defined as q{D, r) = IE7r[5'(U, (7r(r, 77^*^))ie[n])] VTJ G A’’*, r ^ TZ 
Let (j'{D) = M.e{D, q, TZ) be the message selected by the exponential mechanism 
Output a = (7r(cr'(77), 


Lemma 12. Suppose that (a, vr) has coordination complexity i and approximation ratio pfor the objective 
f. Then the algorithm PriCoor((cr, tt), /, e, D) satisfies (e, 0)-joint differential privacy, and with probability 
at least 1 — (3, the resulting action profile a satisfies 


E [5(77, a)] > 


OPT(77) 

P 


2(7 + log(l//3)) 
e 


where the expectation is taken over the internal randomness of the encoding function a' and decoding 
function tt. 

"'We can always obtain this condition by scaling. It is already satisfied in the matching problem. 
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Proof. Since the encoding function is an instantiation of the exponential mechanism, we know from Lemma 11 
that the instantiation PriCoor(((T, tt), g, e, D) satisfies (e, 0)-joint differential privacy. 

Since the coordination protocol guarantees an approximation ratio of p, there exists some message r* in 
the set TZ such that 


E 




q'{Dy) > 


OPT(D) 

P 


Note that A(g') < 1 by our assumption on /. Then the utility guarantee of the exponential mechanism gives 


E 


S{D,{7:{a'{r,D)y^^))yy 


q'(D,7r{a'(r,D))) >ina,xq(D,r) 
r&n 


2(log(|7^| -log(l//3))) 
e 


Also, observe that maxj.g 7 e q'{D, r) > OPT{D)/p and log(|7?.|) < 4 so we also have 


E 


s{D,ycj'{r,D)y^^))yy 


> OPT{D)/p 


2(£-log(l//3))) 

£ 


which recovers our stated bound. 


□ 


5.3 Efficiency in Games with Dynamic Population 

Now we briefly discuss a connection between coordination complexity and the efficiency in games with 
dynamic population, which leverages the connection to joint differential privacy discovered by [LST15]. We 
briefly introduce the model in [LST15], but the discussion will necessarily be lacking in detail - see [LST15] 
for a formal treatment. 

Let G be an n-player normal form stage game. We consider this game played repeatedly with a changing 
population of players over T rounds. Each player i has an action set Ai, type D^'^\ and a utility function 
a) = Ui{a). For concreteness, we can think about allocation games defined by auction rules M, 
which take as input an action profile and output an allocation Xi (o) and a payment Pi (a) for each player. 
Players have quasi-linear utility Ui{a) = Xi{a)) — Pi{a) = Vi{Xi{a)) — Pi{a), where Vi: ^ 

[0,1] denotes the valuation of player i over the allocation. In these games, a natural objective function is 
social welfare: S{D, a) = We write OPT(L)) = maxag_ 4 n S{D, a) to denote the optimal 

welfare with respect to an instance D. 

In the model of [LST15], after each round, every player independently exits with some probability p. 
Whenever a player leaves the game, she is replaced a new player, whose type is chosen adversarially. We 
will write to denote the game instance, and a* to denote the action profile played at round t. Lastly, we 
also assume that each player in the game is a no-regret learner and plays some adaptive learning algorithm.^ 

The main result of [LST15] is that the existence of jointly differentially private algorithms that find 
action profiles approximately optimizing the welfare in a game implies that when the dynamically changing 
game is played by no-regret players, their average welfare is high. 

Theorem 6 (Corollary 5.2 of [LST15]). Consider a mechanism with dynamic population {M,T,p), such 
that the stage mechanism M is allocation based p)-smooth and T > 1/p. Assume that there exists 
an (e, S)-joint differentially private allocation algorithm X* : —)• A^ such that for any input instance 

D G it computes a feasible outcome that is p-approximately optimal 

E[S{D,X*{D)] > OPT{D)/p. 

^For more details of adaptive learning algorithms and adaptive regret, see [HS07]. 
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If all players use adaptive learning in the repeated mechanism, then the overall welfare satisfies 


^E[5(D^a*)]> 


A 

pmaxjl, /i} 


^E[OPT(D*)] 

t 


nT 

max{l, p.} 


v'2p(l + n(e + 5))ln(iVr), 


where N = max* \Ai 


Note that if the problem of coordinating a high-welfare allocation has small coordination complexity this 
implies the existence of a jointly differentially private allocation algorithm with a high welfare guarantee. 
By combining Theorem 6 and Lemma 12, we obtain the following result. 

Lemma 13. Consider a mechanism with dynamic population (M, T, p) such that the stage mechanism 
M is allocation based {X, p)-smooth and T > 1/p. Assume there is a coordination protocol (o', vr) with 
coordination complexity (. and approximation ratio pfor the corresponding welfare maximization problem. 
Then if all players use adaptive learning in the repeated mechanism, the average welfare satisfies 

^E [5(22*, a*)] > -^,^^E[0PT(22*)] - 

^ /3max{l,/r| ^ 

f ji'T , _ 

inf <---- s/Apne ln{NT) H— 

£>0 [maxjl,//} p 


XT 


2{£ + log(n)) 


max{l, p} 


6 Coordination through Dynamics Simulation 

In this section, we give another general technique for designing coordination protocols. The key idea is to 
broadcast a message that is sufficient for players to derive the sequence of actions that they would have exe¬ 
cuted in some joint dynamic that is known to converge to the solution to the coordination problem. Similar 
techniques have been used in the privacy literature, for example [KMRW15], [HHR+14] and [RR14]. We 
will focus on the application of coordinating an equilibrium flow in atomic routing games, which follows 
the general outline of [RR14]. 

A basic primitive that turns out to be broadly useful when writing down the transcript of some dynamic 
is being able to keep a running count of a stream of numbers. For many applications, in fact, it is sufficient to 
be able to maintain an approximate count. Before we start, we introduce two subroutines for keeping track 
of the approximate count of a binary stream using low communication. The first one compresses a numeric 
stream r: [T]—>^{—1,0,1} into a short message, and the second one decompresses it. See Algorithm 3 for 
the simple compression protocol. 

Algorithm 3 ApproxCount(r, r, T) 

Input: a stream of numbers r: [r]^{—1,0,1} and refinement parameter r 
Initialize: a counter C: [T] —N, a list of update steps 2/ = 0 
for f = 1,..., T: 

if f = 1: let C{t) = 0; else: let C{t) = C{t — 1) 
if \C{t) - ELi'^(0I > 

if C{t) < T{i) then C{t) = C{t — l) + r and 2/ 27 U {(f, -t-)} 

if C{t) > ''‘(^) then C{t) = C{t — 1) — r and U ^ U U {{t, —)} 

Output: the list of time steps U 


This algorithm releases a concise description U that suffices to reconstruct an approximate running count 
C{t) of the stream. 
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Claim 4. For all t G [T], the approximate count C{t) satisfies \C{t) — summary 

stalistic U can be «rimn m,h O (Ma^) bits. 

The second one takes the compressed message from ApproxCount as input, and extracts the approximate 
counts. See Algorithm 4. 


Algorithm 4 ExtractCount(C/, r, T) 

Input: a list of update steps U, refinement parameter r, and time horizon T 
Initialize: a counter C: [T] —)• N such that r(f) = 0 for all t G [T] 
for: each (f, •) G 17 
Let c' = C{t — 1) 

if • = +: c = c' + r; else: c = c' — r 
for: each t' ^ {t,... ,T}: 

Let C{t') = c 

Output: the approximate counts C 


Looking ahead, we will use ApproxCount in the coordinator’s encoding function to compress the infor¬ 
mation in the simulated dynamics, and use ExtractCount in each player’s decoding function to extract the 
information about the dynamics. 

6.1 Atomic Routing Games and Best-Response Dynamics 

An atomic routing game instance is defined by a directed graph G = {V, E), n players with their source- 
sink pairs (si, di),..., {sn ,dn), and a continuous, nondecreasing and A-Lipschitz cost function Cg: [0, n] 

[0,1] for each edge e £ E. Each player i needs to route 1 unit of flow from Si fo di, so her strategy set Ai is 
the set of Sj-dj paths. We think of a flow of a single player alternately as a vector indexed by paths P, and 
as a vector indexed by edges e. The aggregate flow is the sum over all player flows. A flow / (viewed as a 
vector indexed by paths) is feasible if for each player i, ffi' equals 1 for exactly one Sj-dj path and equals 0 
for all other paths. We can translate such a flow into a flow indexed by edges by defining f^p- 

The cost cp{f) of path P in a flow / is 


Cp{f) = '^Ceife) 
eSP 


where /e = ^ 11=1 will denote the number of edges by m, the set of feasible flow by P, and some¬ 

times abuse notation to use to denote the path of player i. Now we formalize the notion of approximate 
equilibrium flow in a routing game. 

Definition 7 (Approximate Equilibrium Elow). Let f be a feasible flow for the atomic instance {G, c). The 
flow f is an e-equilibrium flow if each player i G [n] is playing e-best-response, that is for every pair every 
pair of Si — di paths P, P' with f^p > 0, 


cp(/) < cpff) -he 

where f is the flow identical to f except for its i-th component: fp^ = 0 and fp) = 1. When f is a 
^-equilibrium flow, we simply say that f is a equilibrium flow. 
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The classical work of [MS96] establishes the existence of equilibrium flows and shows that an equilib¬ 
rium flow minimizes the potential function T' of the routing game, which is defined as 

/e 

eG-E i=l 

Note that in atomic routing games, equilibrium flows are not unique, and so equilibrium selection is 
important. This motivates the coordination problem we study. 

We will rely on the following fact to show that a flow is an approximate equilibrium. 

Fact 1. Consider a flow f ^ J-. Suppose a player i could decrease her cost by deviating from path P to 
path P, which gives rise to a new flow f, then 

cp{f)-cp{f) = ^{f)-^{f). 

Our goal is to give a coordination protocol that coordinates the players to play an approximate equilib¬ 
rium flow and has low coordination complexity (scaling with the number of edges \E\ instead of number 
of players n).^ A very straightforward procedure to compute an equilibrium flow is the best-response dy¬ 
namics: while the flow / is not a 7y-equilibrium flow, pick a player i and an arbitrary path deviation that 
could decrease her cost. In our coordination protocol, the coordinator will first simulate an approximate ver¬ 
sion of the best-response dynamics, and compress the dynamics into a concise string using the subroutine 
ApproxCount; then the coordinator will broadcast the string to the players so that each player can simulate 
the sequence of actions she would have played in the dyamics, and thus determine the action she plays at 
the end of the dynamics using ExtractCount. 

In our approximate best-response dynamics, we will let the players best-respond to the approximate 
count of players on the edges. We first need to define the a player’s best response with respect to a count 
vector in M™. 

Definition 8 (Best-Response with respect to counts). Given a count vector f* a path for player 

i is an e-best-response with respect to the vector /* if 


Cp(i)(/*) - e < _min cp^iflf). 

Keep in mind that any feasible flow / is also a count vector. We give the formal description of the 
coordinator’s encoding function BR-Sim in Algorithm 5. 

We will now focus on analyzing the best-response dynamics within BR-Sim. Note that in the analysis we 
might say “player plays best-response” or “player deviates”; while these sound natural, all these procedures 
are simulated by the coordinator and the protocol is non-interactive. 

Lemma 14. At any moment of the dynamics, let f G be the flow given by all players’ paths and let 
g G be the count vector given by the counters {Counter(e)}eg_E- Suppose that player i’s path /(*) is 
an p-best-response with respect to g, then the path is an {p -|- Xmr \m)-best-response. 

Proof By Claim 4, we guarantee that throughout the dynamics, for each e G E 

|Counter(e) — f\ < r. 

®The social objective here is not social welfare — we want instead to minimize approximation factor of the equilibrium e. 
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Algorithm 5 BR-Sim((G, {(s*, c), a, r) 

Input: a routing game instance (G, {(si, c), best-response parameter a and refinement param¬ 

eter r such that a > 2Xm{r + 1) 

Initialize: 

mn 

I = a — 2Xmr — Am, T = —^ 

for each edge e £ E 

Let Counter(e) be an instantiation of ApproxCount(-, r, (T -|- l)n) (waiting for incoming stream) 

Form the initial flow: 

for each player i: 

Let /(*) be the Si-di path with the fewest number of edges, break ties lexicographically 
for each edge e: 

if e G send “1” to Counter(e) else send “0” to Counter(e) 

Best-responses dynamics: 
for f = 1,..., T 

if each player is playing an a-best-response w.r.t. the counts {Counter(e)}eg£;: Halt 
for each player i 

if i is not playing an a-best-response w.r.t. the flow {Counter(e)}ee£; 

Lef /(*) be fhe besf-response of i w.r.f. (Counter(e))ee£; (breaking lies lexicographically) 
for each e: 

if e G /W \ /(*); Send “-1” lo Counter(e) 
if e G \ Send “1” lo Counter(e) 
else : Send “0” lo Counter(e) 

Lei /(*) = /(*) 

else: 

for each e: Send “0” lo Counter(e) 
for each e: Lei Ue be Ihe oulpul of Counter(e) 

Output: {Ue}e&E 


This allows us to bound the cost difference of the same path with respect to two flows / and g — for any 
path P C E 

\cp{f) - cp{g)\ < Xmr. 


This implies 

I min cpi(f) — min cpi(q)\ < Xmr. 

P'&Ai P'eAi ~ 

Note that Crq) {g) — minp'g_ 4 . cpi{g) < gby our assumption, then it follows from the last two inequalities 
that 

Cfii) if) < min cp' {f) + g + Xmr, 

so /(*) is a {g+Xmr)-best-response w.r.t. the flow /. Let /' be a deviation of player i and let /' = (/|, ) 

be the resulting flow. We know that for each edge e, j/' — /e| < 1. It follows that 

min cpi(f) < min cpi(f') -|- Am. 

P'eAi P'&Ai 
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Therefore, (/) < minp/g_ 4 . cp/{f') + r/ + Amr + Am, which guarantees that /(*) is a (r/ + Xmr + Am)- 
best-response. □ 

Lemma 15. Every time a player makes a deviation in the dynamics, the potential function T' decreases by 
at least (a — 2Xmr — Am). 

Proof. Let / denote the true flow among the n players. Since the amount the potential function decreases 
equals the amount that player decreases her cost, we can bound Cfw(/)-cj(i)(/')> where/' = {f^\f^ *)). 
Let g denote the count vector given by the counters (Counter(e))eeE. Suppose a player i has her path 
switched from to during the dynamics. Then this means 

min cp{g) = cpi){g) < cm)( 5 ) - a. 

By the accuracy guarantee of Claim 4, 


cp(/) — cp{g)\ < Xmr and 


min cp'i f) 
P'eAi 


min cpdq) 
P'&A^ 


< Xmr. 


This means 

\Cf(i) {g) - Cj(i) (/)| < Xmr and \cp) (g) - cp^ (/)| < Xmr. 
Furthermore, note that \fe — fe\ < 1 for each edge e since they differ by only player i’s path, so 


- cp)if)\ < Am. 

Combining all the inequalities above we get 


Cfd) if) - Cj(i) if) = iCfd) if) - Cf(i) ig)) + (c^(i) ig) - ig)) 

+ (cj(i) ig) — cf{i) if)) + (cj(i) if) — cj(i) if)) 

> —Xmr + a — Xmr — Am = a — 2Xmr — Am, 


which also lower bounds the amount that the potential function decreases. □ 

Lemma 16. At the end of the best-response dynamics, the players are playing [ap Xmr Xm)-approximate 
equilibrium flow in the routing game instance. 

Proof. In each iteration, there is at least one player performing a deviation, which will decrease the potential 
function by at least (a — 2Xmr — Am) = 1. 

Note that the initial flow has potential 


/e 

Ce(i) < nm. 

e£E i=l 

This means after at most T = mn/l iterations of the best-response dynamics, every player is playing a- 
best-response with respect to the flow given by (Counter(e))ee£;. By Lemma 14, each player is playing a 
(a + Xmr + Am)-best-response w.r.t. to the final flow /. Hence, the final flow is an (a -|- Xmr -\- Xm)- 
equilibrium flow. □ 
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Given that we have shown that at the end of the best-response dynamics in BR-Sim, the players are 
playing an approximate equilibrium, it only remains to construct a decoding function for the players to 
recover their own sequence of actions in the dynamics. Observe that BR-Sim outputs the list of update steps 
across all counters, which allows each player to simulate the history of the approximate counts. Therefore 
the decoding function is straightforward: first call ExtractCount to extract the history of counts in the 
best-response dynamics; then each player i first forms her own initial flow by picking the shortest path in 
her action set, and then at every time step t such that [t mod n) = i, she decides whether to switch to 
a best-response with respect to the counts. Since her best response, after breaking ties lexicographically, 
is uniquely determined, in this way she is able to determine which path she is playing along at the end 
of the dynamics, which is her part of the approximate equilibrium. The full description of the algorithm 
ExtractPath is presented in Algorithm 6 . 


Algorithm 6 ExtractPath((sj, dj), {Ue}e&E, a, r) 

Input: a player z’s source-destination pair {si,di), message containing update steps {Ue]e&E for the 
{Counter(e)}ee^;^ best-response parameter a and refinement parameter 

Initialize: I = a — 2Xmr — Am 
for each edge e ^ E: 

Let Ce = ExtractCount(C/e, r, T) be the history of approximate counts 

Form the initial flow: 

Let /(*) be the Sj-dj path with the fewest number of edges, break ties lexicographically 

for f = 1,..., 

Let flow g = {Ce{tn + i))e&E 

if/W 

is not an a-best-response w.r.t. g 
Switch /(*) to a best-response w.r.t. g 
Output: the final Si-di path /(*) 


Claim 5. Suppose that BR-Sim((G, {(sj, d*)}*, c), a, r) outputs a set of update step lists {Ue}eeE, then for 
each player i, her output flow from the instantiation ExtractPath((sj, dj), {Ue}e€E, ct, r) is the same as the 
final flow in the best-response dynamics in BR-Sim. 

Theorem 7. Fix any e > 2Am. Let r = cmd a = e — Xmr — Am. Then given any routing game in¬ 

stance T = {G,{{si,di)}i,c), the coordination protocol (BR-Sim(r, a, r), ExtractPath((sj, dj), {C4}eeE5 ?')) 
coordinates the players to play an e-approximate equilibrium flow and has coordination complexity of 

~ / Xmfn A 
\(e — 2XmY j ' 

Proof Given the parameters we choose, the players will end up playing an e-approximate equilibrium 
by Lemma 16. 

Next, we bound the encoding length of the output from BR-Sim. Recall that I = a — 2Xmr — Am, and 
each time a player makes a deviation in the best-response dynamics, the potential function decreases by 1. 

By the same analysis of Lemma 16, we know that the total number of deviations that occur in the dynamics 
(across all edges) is bounded T = mn/l. Since each counter updates its count only if the count is changed 
by r, the total number of updates across all counters is bounded by mT/r. Also, the total length of each 
counter is bounded (T -I- l)n. By Claim 4, the output list of update steps among all counters has encoding 
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length at most 


O 


\vr?n 
(e — 2\mY 


m?n 


{e — 3Xmr — 2\m)r 
which recovers our stated bound. 


log 


2 2 
m n 



□ 


To interpret the bound in Theorem 7, consider the case in which the routing game is a large game - in 
which n is substantially larger than the number of edges m, and in which no player has a large influence on 
the latency of any single edge. In our context, this means the Lipschitz parameter A of the cost function Cg 
is small. Since the range of the cost is normalized to lie between 0 and 1, it is reasonable to assume that 
A = 0(l/n). Given such a largeness assumption, the result of Theorem 7 gives a coordination protocol that 
coordinates a (m/re)-approximate equilibrium flow with a coordination complexity of 0{m^/e^) for any 
constant e. 


Remark 2. Another application for this coordination technique is the general allocation problem when 
the players have gross substitutes preferences. In this problem, there are n players and m types of goods, 
and each type of good has a supply of s. A coordinator who knows the preferences of the players can first 
simulate m simultaneous ascending price auctions, one for each type of good. The analysis of [KC82 ] 
shows that the prices and the allocation in the auctions converge to Walrasian equilibrium.' each buyer is 
simultaneously able to buy his most preferred bundle of goods under the set of prices. We could then have a 
similar coordination protocol: compress an approximate version of the ascending auctions dynamics using 
ApproxCount, and broadcast a message that allows each player to reconstruct the price trajectory in the 
auctions, which can then coordinate a high-welfare allocation. 
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A A Coordination Protocol For Many-to-One Stable Matchings 

Finally, we present a eoordination protoeol for the many-to-one stable matehings problem, whieh is rela¬ 
tively straightforward. A many-to-one stable matehing problem eonsists of k sehools U = {ui,... ,Uk], 
eaeh with eapaeity Cj and n students S = {si,..., s^}. Every student i has a striet preferenee ordering )^i 
over all the sehools, and eaeh sehool j has a striet preferenee ordering over the students. It will be useful 
for us to think of a sehool n’s ordering over students A as assigning a unique score scoreu(s) G {1,... , n} 
to every student, in deseending order (for example, these eould be student seores on an entranee exam). 
Therefore, eaeh student’s private data is Di = {)^i, {scoret,(s)}„). We reeall the standard notion of stability 
in a many-to-one matehing. 

Definition 9. A matching p : S ^ U L)^ is feasible and stable if: 
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1. (Feasibility) For each Uj G U, \{i : = Uj}\ < Cj 

2. (No Blocking Pairs with Filled Seats) For each a* € A, and each Uj G U such that ^ Uj, either 
hicLi) Fai Uj or for every student a[ G iJ.~^(uj), a' Fuj Oi- 

3. (No Blocking Pairs with Empty Seats) For every Uj G U such that \p~^(uj)\ < Cj, and for every 
student ai G A such that a* )~uj 0. p{cLi) Fat Uj. 

A simple way to specify a matching is to specify an admissions threshold for every school - i.e. a score 
admit(j) that represents the minimum score student the school is willing to accept. A set of admissions 
thresholds admit defines a matching /iadmit in the natural way, in which every student enrolls in their most 
preferred school to which they have been admitted: 

Padmhii) ■= argmaxjrij | score«^.(ai) > admit(j)}. 

A set of admission scores is stable and feasible if the matching it induces is stable and feasible. 

Now we give a coordination protocol to coordinate students to select schools that form a stable matching. 
The protocol crucially relies on the Gale-Shapley deferred acceptance algorithm — the coordinator will first 
simulate the dynamics of the deferred acceptance algorithm based on the student profiles, and obtains the 
stable matching along with the associated admission scores. Then it suffices for the planner to publish 
the list of admission scores so that all the students can coordinate on the stable matching. We present an 
score-based deferred acceptance algorithm in Algorithm 7. 

Algorithm 7 Deferred Acceptance (with Admission Scores) Stab(i7) 

Input: n students’ data D including their preferences over the schools and score profiles 
for each school Uj G U 

admission score admit(j) = n; temporary enrolled students temp(j) = 0 
for each student Si G S: let p.(si) =± 

while there is some under-enrolled school Uj/ such that |temp(j')| < Cj/ and admit(j') > 1 
admit(j') -G- admit(j') — 1 
for each student sp 

if p{si) 7 ^ argmax^^Jttj | score„^.(oi) > admit(j)} 
then temp(j) ^ temp(j) \ {oj} 
p{ai) = aigmaxy^,{uj \ score„^.(ai) > admit(j)} 
temp(/i(ai)) ^ temp(/r(aj)) U {aj 
Output: the final admission scores {admit(j)} 


The following is a standard fact about the deferred acceptance algorithm. 

Claim 6. The final matching p computed from Stab(Z?) is a stable. 

Consider the following coordination protocol: the coordinator will first run Sta b and broadcast the set 
of admission scores, and then based on the score, each student will just enroll in the favorite school that she 
qualifies, thaf is 

argmaxjrij | score^j^.(oj) > admit(j)}. 

>-a^ 

Note that the set of admission scores can be encoded with at most 0{k log(n)) bits. 

Theorem 8. There exists a coordination protocol with coordination complexity of 0{k\ogn) that coordi¬ 
nates the students to coordinate on a stable matching. 
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B Missing Proofs from Section 3 

First, let us first fix some nofations. Given any fwo random variables X and Y, we will write I{X : Y) 
to denote the mutual information, Dyj^{X : Y) to denote the Kullback Leibler divergence, and 5{X,Y) 
to denote the total variation distance between the random variables. We denote the Shannon entropy of a 
random variable Z by H{Z). 

Lemma 1. For p'>l/k,we have i{t, k, p) > (8 log e)t{p — l/k)‘^. 

Proof. Fix a protocol where the coordinator broadcasts £ bits in the worst case. We will show that i. must 
be large. Let M(I) be the (random) message that Alice sends to Bob based on her input I. Let S{I) = 
(5i, 52 ,... ,St) and u{I) = {ui,U 2 ,. ■ ■, ut). Then, 5(1), u{I) and M{I) are random variables. Fix a 
value 5 for 5(1) and so that conditioned on “5(1) = 5” the the probability of success is at least p (such an 
5 must exist). Then, 

I[u{I) : M{I)] = H[M{I) - \ u{I)) < H{M{I)) < E[|M(/)|] < A 

On the other hand, since tti, ri 2 , • • •, Uf are independent (conditioned on “5(1) = 5”), we have 
I > I[u{I) : M{I)] > I[ui : M{I)] + • • • + I[ut : M(/)], 


implying that 

¥.[I[ui-.M{I)]] < 1 
i t 

Let Uiz denote the random variable whose distribution is the same as that of ui when conditioned on the 
event M (I) = z, and let the distance between the distributions of Uiz and Ui be 

6 {uiz,Ui) := ^ I Fr[uiz = m] - Pr[ni = w]\. 
wGSi 


Then, we have 


I[ui : M{I)] = 'E[D-ia^{uiz : Ui)] (from definition) 

z 

>(21oge)E {5{uiz,Ui))‘^ (by Pinsker’s inequality) 

Z I J 

>(2log e) [S{uiz,Ui)]^ . (by Jensen’s inequality) 

With one more application of Jensen’s inequality, we obtain the following 


E [5{uiz : Ui 


> (21oge) E E [5{uiz : Ui)] 


E[I[ui : M{I)]] > (21oge)E 


Suppose Bob succeeds in guessing the special element of Si with probability pp, then Ej[pi] = p. Further¬ 
more, we have 5{uiz,Ui) > 2\pi — l/k\. Thus, by Jensen’s inequality, we have 


E 

i iz 


E [5{uiz : Ui)] j > 4(p - l/Zc)^ 

It follows that £/t > (8 log e){p — 1/A:)^, that is, i > {8 log e)t{p — \lk)^. 


□ 
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Lemma 3. The sampled matching in G' has expected size at least 


OPT' 
3p ■ 


Proof. For w E W, let be the number of copies of good w that have been assigned in the matching M*. 
Then > b OPT' / p. If d^ > 1, then we have the following estimate for the probability that w is 

chosen. 

dru 1 


Pr[t(; is chosen] > d^j^ ^ 


= ^ ( 1 + 


1 


6-1 




> ^ exp(-((iu, - l)/(6 - 1)) 
6 


> 


eb 


(because 1 + x < e^) 
(because d^ < 6) 


( 6 ) 

(V) 

( 8 ) 

(9) 


Let M' be the sampled matching in G'. Then by linearity of expectation: 

6OPT' OPT' 

E[|M*|] > 22 ^^ 


w&W 


eb ebp 


3p 


This completes our proof. □ 

C Missing Proofs from Section 4 

Lemma 4. Suppose we have a dual vector A such that || A* — A|| < a. Let x = argmax^gjr C{x, A), then 

2v^(nA:)V4 


\x — X < 




Proof. Fixing any x, the function £(x, A) is -y/n/c-Lipschitz with respect to £2 norm because for any A, A' 

k n 


||£(x,A) -£(x,A')|| = 




i=l 


(x<-)) 

lA 

1 

n 

Ef (-'•>) 



i=l 


< IIA — X'WVnP 


By thej^roperty of Lipschitz functions we know that g{X) = maxajgjr C{x, A) is also \/^-Lipschitz. Since 
II A* — AII < a, we can then bound 


and also 

It follows that 


||£(x*, A) — C{x*, A*)|| < asfnT:, 

||£(x*, A*) - T(x, A)|| = ||5(A*) - p(A)|| < av^. 


||£(x*, A) — £(x, A)|| < 2av'n/c. 

Note that fixing A, the function C{x, A) is ? 7 -strongly concave in x. Since x is a maximizer of Cf, A), we 
have 

11^ — a;*||^ < - (^C{x, A) — C{x*, A)^ < Aay/nk/p 

Therefore, we must have ||x — x*|| < ^ _ □ 

II II — ^ 
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Lemma 9. Suppose that mm.x^T ll^: — x|| < e. Then with probability 1 — j3, x' satisfies 

< \J 3fclog(/c//3)L + s/nke 

j=i \i=i / + 

Proof. Based on the relation between l\ and £2 norm, we have 

min ||x — x||i < "v/^min ||a: — x|| < sfnke 

x&T xdtF 

This means 

k / n \ 

Y -h] < 

j=l \i=l / + 

Note that for each good j and any <5 € (0,1), we have from Chemoff-Hoeffding bound that 


Pr 


Y^'hj > 


, 2=1 


2=1 


< exp (—(5^n/3) 


Let Xj = we set /3/A; = exp (—(5^n/3), then by union bound we have the following except 

with probability /3 

n / _\ 

for all 3 € [A:], ^ x'j < (1 + log(A;//3)/Xj j Xj 

i=l ' 

Also, v{x) = ||x||i because for any (i, j) such that Vi^j = 0, we must have Xjj = 0, otherwise the player i 
could increase the regularized objective value by having = 0 in Equation (1). It follows that 

k / n \ k _ _ _ 

Y\Y<3-^A ^y Y^3 \og{k/l3)Xj < v^3A;log(A;//3)||x||i = y 3k log{k/f3)V 


j=i \i=i 

Therefore, 


i=i 


E < s/nke + Y 3klog{k/fi)V, 

j=i \i=i / + 


which recovers the stated bound. 


□ 


Theorem 4. There exists a coordination protocol with coordination complexity 0{k\og{nh)) such that the 
parties coordinate on a matching x' with total weight: 


Y j Y ^ ^ 

j=l 


, 2 = 1 


Vk\og{k//3) 

VOPT 


OPT 


as long as OPT > 1. 
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Proof. We instantiate our coordination mechanism for linearly separable convex programs with r] = e = 
l/(100n^A:^), and round the solution to x'. Applying our previous lemmas, we get that with probability at 
least 1-/3: 


E 


mm 



>V — log(4//3)\/y — VnPe — ‘ik\og{2k / I3)V 

> OPT —n(e + ??) — log(4//3)\/p — Vnke — \J 3/clog(2/c//3)P 

> OPT —n(e + r]) — ^log(4//3) + log(2fe//3)^ OPT +n{e + rj) — V^e 

> OPT—n(e + ??) — 4\/fclog(2/c//3 )y^OPT +n(e + rj) — VnPe 

> OPT -8Vfclog(2A://3)VOPT 


which recovers the stated bound. Note that the coordination complexity of this mechanism is 0{k log(n/c)) 
by Lemma 5. □ 
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